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Abstract —We study the effect of fading in the communication 
channels between sensor nodes on the performance of the 
incremental least mean square (ILMS) algorithm, and derive 
steady state performance metrics, including the mean-square 
deviation (MSD), excess mean-square error (EMSE) and mean- 
square error (MSE). We obtain conditions for mean convergence 
of the ILMS algorithm, and show that in the presence of 
fading channels, the ILMS algorithm is asymptotically biased. 
Furthermore, the dynamic range for mean stability depends 
only on the mean channel gain, and under simplifying technical 
assumptions, we show that the MSD, EMSE and MSE are 
non-decreasing functions of the channel gain variances, with 
mean-square convergence to the steady states possible only if 
the channel gain variances are limited. We derive sufficient 
conditions to ensure mean-square convergence, and verify our 
results through simulations. 

Index Terms —Adaptive networks, distributed estimation, in¬ 
cremental, least mean square. 

1. Introduction 

Many applications require us to learn or estimate some 
parameters related to a phenomenon of interest, based on 
all the available observations in a network 0 - 0 . Various 
schemes have been investigated in the literature to facilitate 
this, including the use of a fusion center to perform de¬ 
centralized detection and estimation 0-0, and distributed 
methods that do not rely on a fusion center. An example 
of a distributed method is the consensus strategy in 

which each node performs a local estimation and fuses its 
estimate with those of its neighbors so that all nodes converge 
to the same estimate as the number of iterations increases. 
An alternative distributed approach is the incremental update 
method (Tg-(T7), which relies on nodes passing updates to 
each other in a Hamiltonian cycle in the network. Yet another 
method is the diffusion strategy fT^-p5| that performs online 
estimation in a distributed manner by letting each node update 
its local estimate based on information from all its neighbors 
and over multiple observation epochs. In both the incremental 
update and diffusion approaches, techniques from distributed 
optimization | [26| , p7| are incorporated into the updates and 
local estimates need not converge to the same value, which 
leads to better performance over consensus strategies | [28| . 
Networks that rely on in-network processing at each node 
while allowing the node estimates to update and adapt to 
new sensor observations have come to be known as adaptive 
networks |T2), (22)-(24). 

One of the most popular approaches to modeling the 
underlying process observed by the nodes in an adaptive 
network is to adopt a linear model and use a least mean 
squares (LMS) criterion in the estimation procedure. This is 


because of its simplicity and wide applicability, for exam¬ 
ple in localization of targets, collaborative spectrum sensing, 
and in modeling group behaviors in biological systems 0. 
p4| . In this paper, we investigate the performance of the 
incremental LMS (ILMS) algorithm in a wireless adaptive 
network with communication links between neighboring nodes 
modeled as fading channels. In the original ILMS strategy 
proposed by p9| , it is assumed that nodes communicate 
with each other via ideal links. However, this is typically 
not true in practice. In |[^-p4|, the effect of additive link 
noise in the communication channels between nodes have 
been investigated. In p5| , the performance of general adaptive 
diffusion algorithms in the presence of imperfect information 
exchanges, including quantization errors, and model non- 
stationarities has been considered. All these works however 
do not apply directly to a wireless sensor network, whose 
communication links are usually modeled by fading channels 
| [36| . The references | [37| , propose diffusion LMS algo¬ 
rithms for wireless sensor networks with fading channels but 
under the assumption that channel state information is known 
so that channel equalization can be performed. However, in 
practice the fading coefficients can only be estimated up to an 
uncertainty. Moreover, such channel equalization may be im¬ 
practical for channels with time varying channel information. 
As wireless sensor networks have many important practical 
applications like building structure monitoring, it is therefore 
important to investigate the performance of adaptive networks 
in the presence of fading channels, without full knowledge of 
channel state information. 

In this paper, our objective is to investigate how the perfor¬ 
mance of the ILMS algorithm is affected by the channel fading 
statistics of the communication channels between nodes. We 
restrict our analysis to the ILMS algorithm instead of the 
more general class of diffusion algorithms because of the 
significantly more complex analysis involved for diffusion 
algorithms, which is out of the scope of this paper. Never¬ 
theless, to the best of our knowledge, this work is the first to 
analytically evaluate the performance of the ILMS algorithm 
in a practical wireless sensor network with fading channels, 
without exact knowledge of channel state information. We 
believe that many of the insights obtained in this paper are 
applicable to more general diffusion algorithms, which will 
be addressed as part of future work. Our main contributions 
in this paper are the following: 

(i) We show that the ILMS algorithm over fading channels, 
like the traditional ILMS algorithm, is stable in mean if 
the step size is chosen in an appropriate range. We show 
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that this range now not only depends on the regression 
correlation, but also on the mean of the channel fading 
gains. Moreover, our analysis reveals that in general, 
fading communication channels lead to biased estimates 
in steady state. 

(ii) We derive closed-form expressions for the steady state 
performance metrics, including the mean-square devi¬ 
ation (MSD), excess mean-square error (EMSE) and 
mean-square error (MSE), of the ILMS algorithm in 
the presence of fading channels, and under a Gaussian 
model. We show explicitly how these metrics are affected 
by the fading channel statistics. 

(iii) We derive sufficient conditions for the convergence of 
the MSD, EMSE and MSE, and show that for a fixed 
step size, mean-square stability is lost if the channel 
gain variances become large. Under simplifying technical 
conditions, we show that under the decibel (dB) scale, 
the MSD, EMSE and MSE are approximately non¬ 
decreasing linear functions of the channel gain second 
order moments. 

We also perform extensive simulations to verify that our 
theoretical analysis closely matches the actual steady state 
performance observed in a network. 

The remainder of this paper is organized as follows. In 
Section |n| we describe our system model and assumptions. 
In Section |I^ we present theoretical analysis of the steady 
state performance of the ILMS algorithm over fading channels, 
and discuss some of our results. In Section |lvj we present 
simulation results to verify our theoretical analysis, and we 
conclude in Section El 

Notation: We adopt boldface letters for random quantities. 
The symbol * denotes conjugation for scalars and Hermitian 
transpose for matrices. The notation col{-} denotes a column 
vector (or matrix) with the specified entries stacked on top of 
each other. The notation diag{-} will be used in two ways: 
X = diagjx} is a diagonal matrix whose entries are those 
of the vector x, and x = diag{X} is a vector containing the 
main diagonal of X. The exact meaning of this notation will 
be clear from the context. We let 1 = diag{/} denote a vector 
consisting of all Is. We use Aniax(^), Amin(^) and p{A) to 
denote the largest eigenvalue, smallest eigenvalue, and spectral 
radius of A, respectively. If E is a matrix, we use the notation 
11^ III = x'^Ex for the weighted square norm of x. If cr is a 
vector, the notation ||x||cr is used to represent ||x||diag{cr}- 

II. Problem Eormulation 

In this section, we first describe the data model, and give 
a brief overview of the traditional ILMS algorithm in p9| . 
We then describe how the ILMS updates are changed when 
information is communicated over fading channels. Einally, 
we list the assumptions we are making throughout this paper. 

Consider a network composed of N nodes. At time i, node 
k observes a scalar measurement dk{i) and a 1 x M regression 
vector Uk,i, which are related via a linear regression model 

dk{i) = Uk,iw'' ^Vk{i), (1) 

where Vk{i) is the observation (or measurement) noise, and 
the M X 1 vector = [u;^(l), u;^(2), • • • ,u;^(M)]^ is a 


deterministic (but unknown) vector. Based on the intended 
application, may have different physical meanings. Eor 
example, may represent the location of a target in space, 
or the parameters of an AR model p4| , | [25| . We make the 
following assumptions regarding the data model in Q- These 
assumptions are commonly assumed in the literature p4| , flSl , 

(29). 

Assumption 1: 

(i) Eor k = and i > 1, the regression vectors 

Uk,i are independent over node indices k and observation 
times i. 

(ii) The measurement noises Vk{i) for all nodes k = 
1,..., A^, and all observation times i > 1, are zero-mean 
and independent of each other and the regression vectors 

^k,i' 

The goal of the network is to estimate at every node k, 
using all observed data in the entire network. Mathematically, 
the network seeks to find that minimizes the following 
LMS objective function: 

N 

E [\dk{i) - Uk,iw\'^] . (2) 

k=l 

It can be shown that the minimizer of satisfies the 
normal equation | [39| . 

C N \ ^ 

X I IX 

k=l j \fe=l 

where 

Ru,k = and ra,u,k = E[<ifc(iX^i]. 

A. The ILMS Algorithm over Ideal Links 

In p^ , an adaptive network based on incremental 

cooperation amongst nodes at every observation time has 
been developed wherein nodes communicate through a pre- 
established Hamilton cycle. This is known as the ILMS 
algorithm. Each node k receives a local estimate from the 
previous node k — 1, updates it using its local data, and then 
sends it to the next node k-\-l, where node indices are modulo 
N. The update equations for the ILMS algorithm, at iteration 
i is given by (E) 

Wo,i ^ WN,i-l .2) 

~ '^k — l,i l^k (^) ^k,i^k — l,i^ 

where Wk,i is the local estimate of the node k at time i. It is 
shown in (T2|, p4| that as i ^ oo, we have Wk,i in 

the mean, for every node k, and for an appropriately chosen 
set of step sizes {pk : A: = 1,..., N}. 

B. The ILMS Algorithm over Fading Channels 

In this paper, we consider the case where nodes communi¬ 
cate over fading channels (see Eig. [T]). To model model the 
Impact of channel, let denote by rk,i the received signal at 
node k and time i. By incorporating the impact of fading 
channels we have 

rk,i = hk{i)wk-i,i+qk,i 



(4) 
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Fig. 1. The incremental LMS adaptive network with fading channels. 


hk{i) are available. We can see that in this case the ILMS 
algorithm with fading channels behaves like the ILMS network 
with noisy links. 

Remark 2: In practice, the channel fading coefficients hk{i) 
are not available and only can be estimated by e.g. training 
data. In this case even if the nodes perform channel state 
estimation, it is not possible to measure the channel gains 
with absolute certainty, especially if the channels experience 
fast fading. To further the motivation for using ([^, let hk{i) 
be the estimate of the fading coefficient Then, the ZF 

equalizer coefficient becomes 


Using 0, the update equation for node k in ^ becomes 

^/c,i — k'k^k^i {^k{^) ^k,i'f*k,i) ( 5 ) 


4(^) 


K{i) 

\\hk{iW 


(9) 


where hk{i) is the channel gain at time i for the commu¬ 
nication channel between node k — 1 and k, and ^ is the 
additive channel noise. The update equation ^ in terms of 

hk{i), Wk-i,i and as 

Wk,i = hk{i)wk-i,i-\-qk4 

+ likul^^ [dk{i) - Uk^i{hk{i)wk-i^i + q^^^)) , ( 6 ) 


We make the following assumptions regarding the fading 
channel statistics. 

Assumption 2: 

1) We assume phase coherent reception at every node k and 
model the channel gain as a non-negative random variable 


Kii) 


as the mean 


with rrik = E[hk{i)] and s/c = E 

and second order moment of the ctiannel gain for node 

k, respectively. 

2) The channel gains hk{i) for all nodes k = 1,..., A^, and 
all observation times i > 1, are independent of each other. 
For each node k, the channel gains {hk{i) : i > 1} are 
identically distributed. 

3) The channel gains hk{i) for all nodes k = 

and all observation times i > 1, are independent of 
{di{j),uij) for all I and j. 

4) The additive channel noises q^ ,^ for all nodes k = 

l, ...,A^, and all observation times i > 1, are zero- 
mean and independent of each other, the observation 
noises Vi{j), and the regression vectors Ui^i for all I 
and j. The channel noise q^^ ^ has covariance matrix 


Q/j. = E 




Remark 1: When the channel fading coefficients hk{i) are 
available, we can use zero-forcing (ZF) equalizer to mitigate 
the effects of fading channels. To show this, let denote hy Zk^i 
the ZF equalizer coefficient which is given by 

Kii) 


Zk{i) = 


(7) 


WhkiiW 

Multiplying the received signal with the ZF equalizer coeffi 
cient gives 


I'm = Zk(i)rk,i = Wk-i,i + q'k^i (8) 

where ^ can be interpreted as the effect of 

fading channel in the special case when the fading coefficients 


Using ([^ • in ^ changes to 

+ qk,i (10) 


where 


h'kii) = 


hk{i)hk{i) 

\\hk{iW ’ 


^k,i 


A 

WhkiW 


( 11 ) 


We can see from ( p^ that when the nodes perform channel 
state estimation the channel gain for node k can still be 
modeled as a non-negative random variable with a non-trivial 
variance. Of particular interest is the case where channel 
estimation is sufficiently accurate on average so that the 
channel gain can be partially accounted for at the receiver 
node. In this case, we can assume that ruk = I and > 1. In 
the next section, we show how the performance of the ILMS 
algorithm depends on both rrik and Sk- 


III. Performance Analysis 


In this section, we analyze the mean stability and steady 
state mean-square performance of the ILMS algorithm when 
communication channels between nodes are fading channels. 
Our analysis is based on the energy conservation approach of 


(H, |39). 


In our analysis, we will use the deviation between an 
observed measurement and its prediction based on the current 
local estimate, which is defined as 


dkii^ ^k,i^k — l,i') 


and the weight error vector, which is the deviation between 
the local estimate Wk^ and its true value given by 

Wk,i = -Wk,i. 

It must be noted that in mean and mean-square analysis of 
the ILMS algorithm with fading channels, we need to evaluate 
the first and second order moments of the weight error vector 
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A. Mean Stability Analysis 

Consider the update equation (1|(. By subtracting from 
both sides of •if and using the definition of Wk,i we obtain 


-|- (1 h]^{iy)w 

b'k'^k^i'^kiS) b'kif ^k{p)^'^k,i^k,i'^ Qk,i 
H“ b'k^k,i'^k,iQk,i' (12.) 


The recursion ( p^ shows how the weight error vector Wk,i 
evolves over each update of the ILMS algorithm at time i. 
We use it to derive the required sufficient conditions for mean 
convergence of the ILMS algorithm with fading channels in 
the following result. 

Proposition 1: Under Assumptions and the ILMS 
algorithm over fading channels, given by the update equation 
is stable in mean for any initial conditions if we have 


max < 0, 


m/e - 1 


'^/c'^min ,/c) 


< M/c < 


m/e 


m/eA 

max {Ru,ky 


(13) 


Proof: To derive the stability condition in the mean, we 
need to derive a condition on the step-size in order to guarantee 
convergence in the mean so that lim 'E[wk,i] = 0. To this end 

_ i^oo ’ 

we consider again ( p^ . By taking expectation on both sides 
of ( p^ and using Assumptions yields 


E = mfc JfeE [wk-i,i] + (1 - mk)JkW° (14) 


with 


Jk — I l^kRu,k‘ 


(15) 


By iterating ([T§, we obtain that the weight error vector 
evolves according to 


N 


^ ^nJnj ^ —l] 

N / N \ 

+ ^ ( (1 - TO„)J„ jq rriiJi j w°. (16) 


n=l 


£=n+l 


We can see from ( p^ that convergence in mean for the ILMS 
algorithm with fading channels depends on the modes of the 
matrix 


N 


A1 = ]q m„ J„. 


(17) 


n=l 


The necessary and sufficient condition required for conver¬ 
gence of in the mean is that the matrix M be stable. 
Equivalently, all eigenvalues of Ai must be inside the unit 
circle, i.e.. 


p{M)<l, (18) 

We already know that the spectral radius of any matrix X we 
have p{X) < ||A|| for any induced matrix norm | [40} . Thus 
we have 


p{M) < \\M\\ 

< ||miJi||||m 2 J 2 || • • • ||mivJjvll 
= /5(mi Ji)p(to2 J 2 ) • ■ • piniNJN) 


Since every {Jk} is a Hermitian matrix, its 2-induced norm 
agrees with its spectral radius, which explains the last equality. 
Thus, to guarantee that for any k the constraint ( p^ is satisfied 
if for all /c = 1,..., A^, it is enough to have p{mkJk) < 1 
which can be stated in terms of the A of Ru^k as 

\mk{l-pkX)\ < 1. (19) 


Therefore, if the step-size pk is chosen such that 

rrik-l \ ^ ^ m/c +1 

'^/c Amin {Ru,k) j rrikX max {Ru,k) 

convergence of Elwk^i] in the mean is guaranteed, and the 
proof is complete. ■ 

Remark 3: It is worth noting that for the traditional ILMS 
algorithm in ([^, where information is exchanged perfectly 
over ideal links (i.e., we have rrik = 1 for all nodes k), the 
convergence condition (El reduces to 

^ Pk ^ T 7 ^ T, ( 20 ) 

^max v-^u,/c ) 

which is the same as that derived in m). 

Remark 4: We can conclude from ( p^ that even in the pres¬ 
ence of fading channels, it is possible to ensure convergence of 
the ILMS algorithm in the mean, by choosing sufficiently 
small for all nodes k. Furthermore, the range that the step 
size can be chosen depends only on the mean of the channel 
fading statistics. This implies that if the channel gain can be 
estimated so that the resulting deviation gives ruk = 1, then 
the step size can be chosen to be the same as in the ideal link 
case. Furthermore, by comparing ( p^ with ( [^ , we see that, 
in the presence of fading channels, the allowable range of step 
sizes for stability in mean can increase or decrease depending 
on the average channel gain. 

Proposition 2: Suppose that Assumptions andhold, and 
that pk satisfies ( p^ for all /c = 1,..., A^. Then, for the ILMS 
algorithm over fading channels, we have 

lim E [Wk,i] 

i^oo 

N / N \ 

= (/- 7V4)“^ ( (1 - m„)J„ JJ miJAw°. 

n=l \ £=n-\-l J 

Proof: At steady state, we have lim^^oo '^[ii^k,i] = 
lim^^oo IE [fi/c^i-i] for every node k. Taking the limit as 
i ^ (X) in ( p^ , we obtain the desired result. ■ 

Remark 5: From the proof of Proposition it follows that 
if rrik = 1 for all nodes k, then the ILMS algorithm is 
asymptotically unbiased, which is consistent with the result for 
the mean convergence of the ILMS algorithm over ideal links 
or links with only additive noise p0| , ID- Furthermore, we 
see that if channel estimation achieves an error with average 
mean ruk = 1 for all channels, then the ILMS algorithm 
will also produce an asymptotically unbiased estimate. On the 
other hand, if rrik 7^ 1 for some of the nodes k, then it is 
possible for the ILMS algorithm to produce an estimate that 
is asymptotically biased. From Proposition this bias is the 
same for all nodes in the network. This is reminiscent of the 
convergence result for the ideal link case, which states that all 
the estimators Wk,i converge in the mean to w^. 


max < 0 
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B. Steady State Mean-Square Performance Analysis 

We now consider the steady state mean-square performance 
of the ILMS algorithm over fading channels. We are interested 
to quantify the performance using the following metrics at 
every node k\ 


rjk = lim E 


i^oo 


Cfe = lim E \\wk-i,ifR 




\wk-i,i\f\ (MSD) 

(EMSE) 


a ^ lim E [\ek{i)f] =Ck + (MSE) 

1^00 ’ 


( 21 ) 

( 22 ) 

(23) 


In general, to derive the above steady state performance met¬ 
rics, we need to evaluate quantities of the form E [||i5/c,i|||^] 
where E/e is a positive semi-definite Hermitian matrix. To this 
end, we consider the weight vector update equation given by 
([Tg. Let 


From the above definitions, equation ( [26| ) can now be rewritten 
in the following equivalent form 


E 


\\Wk 




= E 


\\Wk- 


i.illa; 




■E 


\\QkM 


r,o||2 




(32) 


where in 


we have 


Gk — E/j /^/cE 

= T>k — /i/c(E/cA/c + A/cE/c) 

+ Mfc(^/cTr[E/cA/e] + A/cE/eA/c) (33) 
S'/c = SkGk (34) 

T/c = (1 — 2mk + Sk)Gk 

Hk4 = {ruk - Sk){Ck-i,iGk + GkCk-i,i) (35) 


Gk,i = rnkJkGk-i,i + (1 - '^k)Jk, (24) Further algebraic manipulations of ([^ yields 


where Co,i = GN,i-i, and Co,i = I. Note that the matrix Gk,i 
is such that 


E [Wkf = Gk^iw"". (25) 


By equating the weighted norm of both sides of taking 
expectations and using Assumptions and and ( [25] ), we 
obtain the following recursive relationship: 


E [||wfc, 




:E 

■E 


IK-1,illl' 


\\Qk. 


i\\Gki 


Ihll 




(26) 


E 


IK.illl 


= E 


ll^/c—l,i llx:' l^k^v,k'~^^[-^k'^k] 

k J 

■ ^r[QkGk] + ^r[Dfk] + Tr[DHk^i]. (36) 


To derive ([21])-([23]), we only need to consider the case where 
E/c is a diagonal matrix. In this case, matrix E'/. is also a 
diagonal matrix. We let 


(Jk = diag{E/e}, cr^ = diagjE';.}, A/, = diag{A/,}, (37) 


and 

Fk = I — l^kXk + (38) 


where 


Gk — E/j l^kM' \^k'^k,i'^k,i '^k,i'^k,iFik\ (27) 

-h/i^E \\\Ukf\^^Uk,i^k,i\ 

K = ^kGk (28) 

T/c = (1 — 2mk + Sk)Gk (29) 

Hk,i — (^/c ^k^{Gk — l,iGk H“ GkGk—l^i)' (30) 


In order to compute all the moments that appear in the recur¬ 
sive equation ( [26] ) and to obtain closed-form expressions, we 
now make the following assumption regarding the regression 
vectors Uk, for all nodes /c = 1,..., A^. 

Assumption 3: For each k = 1,..., A^, the distribution of 
Uk is 3. Gaussian distribution with 


Ru^k = UkAkUl, (31) 


where A/, is a diagonal matrix with diagonal elements being 
the eigenvalues of the correlation matrix Ru^k^ and Uk is 
unitary matrix. 

Making use of Assumption [^ we further define the follow¬ 
ing transformed quantities: 


'^k,i — Uk'^k,is 

E' = Ul^'kUk. 
Tk = UlTkUk. 
= Ulw-, 

Qk = UkQkUk, 


E/c = U^T^kUk, 

^k,i = '^k,iUk, 

Hk,i = UlHk^iUk, 
Gk-i,i = U^Gk-i,iUk, 
D = . 


with Xk = 2Ak and Yk = A^ - 1 - A/^A^. The M x M matrix Fk 
contains the statistics of data local to node k. We then have 


E[|K,,||?J =E 



+ gk,i<^kj 


where pk^i and are given respectively by 

9k,i = l4^l,k>^k +diag{(3fc}^Ffc 
+ (1 - 2mk + Sk)dmg{D}'^Fk 
+ 2{mk - Sk)diag{D}'^Ck-i,iFk, 
^k ~ ^kFk^k- 


(39) 


(40) 


We next use ( [39] ) to derive conditions that guarantee conver¬ 
gence in the mean-square sense for the ILMS algorithm with 
fading channels. 

Proposition 3: Under assumptions [^ and [^ the ILMS 
algorithm over fading channels converges in the mean-square 
sense if the step sizes pk are chosen to be sufficiently small 
so that the 


SkP{Fk) < 1. (41) 

Proof: From ( [3^ and using the results in Section 6.9 of 
p4| , the ILMS algorithm with fading channels is stable in 
the mean-square sense if matrix = SkFk is a stable matrix. 
Therefore, if we select the step size pk to be sufficiently small 
so that p(F^) < 1, then stability in the mean-square sense is 
guaranteed. The proof is now complete. ■ 

Remark 6: Suppose that Sk = s fox all nodes k, and the 
step sizes pk are fixed. Then, if s is sufficiently large, the left 
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hand side of ( [^ diverges and we no longer have mean-square 
stability. This shows that deteriorating fading conditions have 
detrimental impact on the ILMS algorithm, and care should 
be taken to adjust the step sizes according to Proposition 

Assuming that step sizes are chosen sufficiently small, and 
by letting i ^ oo, the recursive equation ( [39] ) at steady-state 
gives 

E[|Koo||?J =E 

where 

9k = + diag{Qfe}^Ffe 

+ (1 - 2mk + Sk)diag{D}'^Fk 
+ 2(mfe - Sfe)diag{D}'^Cfe_i,oo-Pfc, (43) 
and using •111 and ( [25] ), Ck-i,oo in ( |4^ is given by 

Ck-i,^ = Ul(^iI-M)-^x 

N ^ N 

(1 - mn)Jn H rriiJi 

n=l ^ l=n+l 

We observe that shows how E [lliD/e^oolllfc] evolves 
through the network, which in its current form makes it diffi¬ 
cult to derive the desired metrics (l^-@ directly. In fact, we 
have to find a recursive equation that reveals how E [||th/c,i |||^] 
evolves in time. By iterating ( [^ , and using 
we can obtain a set of N coupled equations. With suitable 
manipulation of these equations, along with proper selections 
of a/c, it is possible to solve the resulting equalities to derive 
the desired metrics. Following the argument given in (13 
we can derive the required metrics in a similar way. For 
completeness, we provide an outline of the proof in Appendix 

El 

Proposition 4: Under Assumptions □ 13 and[^ the steady 
state performance of the ILMS algorithm over fading channels 
for each node k in the mean-square sense is given by the 
following expressions: 



\Uk. (44) 


||^/c-l,oo lla' 




(42) 


Vk = ak{I - 

Cfe = (kk{i — njk,i)“ \k 

ik = Ck + crli^ 


where 


Iik,i = 


N 


) ( Fk^i-iFk^i • • • FnFi • • • Fk-i 

k=l 


(^k — gk^k,2 + Qk+l^k,?, + • • • + gk-2^k,N + gk-h 


(45) 

(46) 

(47) 


(48) 

(49) 


where / = 1, • • • and all the subscripts are in mod N. 

Remark 7: Note that g'^ = is the equivalent 

expression for ( [43] ) for the original ILMS algorithm over ideal 
communication links (see equation (55) in p^). By comparing 
( |4^ with equation (55) in fT^ , we can see that we can model 
the effect of fading channels as additional terms to g'^ with 

9 k= g'k+ di&g{Qk)^Fk + (1 - 2 mfe + Sfc)diag{Z)}^Ffe 

+ 2(mfc - Sk)diSig{DYCk-i,ocFk- (50) 


The first additional term on the right hand side of is due 
to the additive noise of the fading channel. The rest of the 
additional terms are due to statistics of the fading channel. 


C. Dependence of MSD, EMSE and MSE on Channel Gain 
Variances 

In this subsection, we investigate the dependence of the 
MSD, EMSE and MSE on the channel gain variance or 
second order moment by making some assumptions in order 
to simplify the analysis. We show that the MSD, EMSE and 
MSE are non-decreasing functions of s/^. To do this, we adopt 
the same Gaussian model used in the previous subsection, with 
the further assumptions that 

1) rrik = 1, Ru,k = A/, Qk = 

2) pk = g and g is sufficiently small so that ( [4T] ) holds, and 
Fk can be approximated as 

Fk^I- gX = {1- 2g\)F 

Since Fk is now a diagonal matrix, the matrix Ilk,i ~ 
F 1 F 2 • • • Fn is also diagonal, and can be approximated as 

Uk,e^Sp{l-2fiXgi, (51) 

with Sp = nf=i Sk- Using ([5T]( we have 

I-Uk,e^{l-Sp{l-2^i\g)I (52) 

Similarly, we can also obtain approximations for gk and Ok as 
follows: 


gk 


^k 


+ Sp{sk - 1)(1 - 2/iA)diag{L)}^ 
+ o'c,fc(l - 2liA))) 

+ Sp{sk - 1)(1 - 2/uA)diag{D}^ 

Sp(l - 2iJ,\g I L] - 9k-i + flfc-i 


, n=l 


N 

fa (sp(l - 2fiXg) + (sp(l - 2iiXg)gk-i. (53) 

n=l 

Let gk = (/fcl. Since diag{D} = [|u;°(l)p, ■ ■ ■ , \w°{M)\‘^]'^, 
we have 


9k =9 a^p + a^gi-2nX) 


o\\2 


+ Sp{sk - 1)(1 - 2gX)\\w^\\ 

Replacing ( [5^ and ( [5^ in ( [45] ) we finally have 


Vk 


1 


^l-Sp(l-2/iA)^ 
Similarly, we obtain 


N 


~ 1 ) gn + Qk-l^ 


(54) 


n=l 


Ck 


{l-Spil-2^X)^ 


N 

gn + A^/c_i, 

n=l 


(55) 


and the approximation for the MSE ^k follows from (E3- 
Since gn is a non-decreasing and non-negative function of Sk 
for all k, from ( [54] ) and ( [55] ), we see that the MSD, EMSE and 
MSE are all non-decreasing functions of Sk (or equivalently 
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Fig. 2. Node profile and channel noise information: ^ (up), ^ (middle) 

and Tr{Ru^k) (down). 
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the channel gain variances since we have assumed that the 
channel gain mean is 1). 

Suppose further that 5/^ = 5 > 1 for all /c = 1,..., A^, and 
the step size r is chosen so that s{l — 2/iA) is a constant in 
(0,1) for all values of s. In this case, from ( [54| ) and ( [55] ), 
we obtain r]k = 0{Ns^~^^) and (k = This 

means that under the dB scale, the MSD, EMSE and MSE are 
approximately linear with respect to the channel gain second 


order moment. Simulations in Section IV are presented to 
verify our conclusions. 


IV. Simulation Results 

To verify our theoretical performance analysis, we present 
some simulation results and compare them with the results 


in Section III We assume a network composed of V = 20 
nodes, where the nodes are connected via a ring topology 
as in the ILMS algorithm. The regressors Uk,i are generated 
as independent realizations of a Gaussian distribution with a 
covariance matrix Ru^k whose eigenvalue spread is 4. The 
measurement data dk{i) at each node k is generated by using 
the data model Q where the parameter is chosen to 
be [1 1 1 l]^/2, and the observation noise Vk{i) is drawn 
from a Gaussian distribution with variance ^ as shown 
in Eigure [^ The additive channel noises are generated from 
Gaussian distributions with covariance matrix Qk = 

/c = 1,..., 20. The values of ^ are shown in Eigure 0 We 
generate the channel gains hk{i) using a Rayleigh distribution 
with rrik = v^/2 for all values of /c. To obtain the steady-state 
values of MSD, EMSE and MSE, we run the ILMS algorithm 
with 2000 iterations and average the last 200 samples. Einally, 
each steady-state value is obtained by averaging over 100 
independent runs. 

In Eigure we show the steady-state performance metrics 
MSD, EMSE and MSE as functions of the node index k when 
the step size /i = 0.02. We can see that the simulated results 
closely match the theoretical results. In Eigure [^ we have 
plotted the steady-state EMSE at node k = 1 versus step size 
R. We see that in contrast to the ideal link case, the curve is 


Fig. 3. Steady-state curves versus for each individual node k, fi = 0.02. 



Fig. 4. Steady-state EMSE versus for node k = 1. 


no longer a monotonically increasing function of the step-size 
R 

To show how the channel statistics affect the estimation 
performance, we simulate the case where all channels have 
average gain 1. We further let Sk = s for all /c = 1,..., 20, 
and evaluate the EMSE performance when s increases. We plot 
the steady-state EMSE at node k = 1 versus varying values 
of s in Eigure The step size is chosen as ji = 0.02. It can 
be seen that as 5 increases, we get worse performance. On the 
other hand, as 5 -> 0, the performance of the ILMS algorithm 
over fading channels tend to the steady-state performance of 
the ILMS algorithm with additive noise links. Similar behavior 
is also seen for other steady-state metrics, i.e. MSD and 
MSE. This simulation also verifies our prediction of the linear 
relationship between EMSE and 5 in dB. 

Although we assume that the regression vectors Uk,i are 
independent in this paper, our simulations indicate that the 
theoretical results also hold approximately for regression vec¬ 
tors with a shift structure (Tg To show this, we suppose that 
at each node k, and for all times i, the regression vector Uk^i 
can be expressed as 


non-negative function f{x) is 0{g{x)) if there exists a > 0 and xq 
such that for all x > xq, f{x) < ag{x). 


Uk,i = [uk{i),Uk{i - 1), • • ■ ,Uk{i - M + 1)], 

































































Fig. 5. Steady-state EMSE versus channel gain second order moment s for 
node k = 1. 



Eig. 7. Steady-state EMSE versus /j. for node k = 1. We have considered 
regression vectors with shift structure. 


where Uk{i) is generated according to the following recursion 

Uk{i) = OLkUk{i - 1) + PkTk{i), (56) 

which represents a first-order autoregressive (AR) process 
where with a pole at ct/j. In ( [56| ), Tk denotes a white, zero- 
mean, Gaussian random sequence with unit variance, while we 
choose ak G (0, 0.5] randomly and Pk = yj 
Figure we show the steady-state performance metrics MSD, 
EMSE and MSE as functions of the node index k. We can see 
that for this case the simulated results have good match with 
the theoretical derivations. We also have plotted the steady- 
state EMSE at node k = 1 versus step size fi in Fig. 




Eig. 6. Steady-state curves versus for each individual node k, fj, = 0.02. 


depends on the channel gain variances, with the MSD, EMSE 
and MSE being non-decreasing functions of these variances. 
We present simulation results to verify our theoretical analysis. 
Simulation results also show that the EMSE performance 
degrades as the fading channel gain variance increases. 

In this paper, we focus on analyzing the effect of fading 
channels on incremental updates for the LMS filter. We believe 
that most of the insights obtained from this analysis are appli¬ 
cable to the more general class of diffusion LMS algorithms, 
whose performances under fading channels deserve further 
research. 


Appendix A 

Outline Proof of Proposition!!] 

In this appendix, we provide an outline proof of Proposition 
|4|for completeness. The proof steps are the same as those given 
in (H except with additional rrik and Sk terms. 

As we mentioned before, ( [4^ is a coupled equation since 
it involves both E [||wfe,j|||J and E \\wk,i\\l^_^ , i.e., infor- 
mation from two spatial nodes. However, we need to find a 
recursive equation that reveals how E evolves in 

time. We can exploit the ring (incremental) topology together 
with the weighting matrices to resolve this difficulty. To this 
end, let = Wk,oo- By iterating ( [42| ) and using ( |40| ), we 
obtain the following coupled equalities 


E[||Pil|?J =E 
E[||P2liy =E 


ll^^ivllsiFiCTi 


IIPlII 


S2F2Cr2 


^92^2 


V. Conclusion 

In this paper, we have investigated the steady state perfor¬ 
mance of the ILMS algorithm when the links between nodes 
are fading channels, and we do not have perfect channel state 
information. Our analysis reveals some interesting behaviors, 
including (i) in the presence of fading channels, the ILMS 
algorithm is asymptotically biased, (ii) a dynamic range for the 
step-sizes for mean stability that depends only on the mean 
channel gain can be derived and (iii) mean-square stability 


E 

\\Pk-2\\k_, 

= E 

l-P/c —3 Lfc-2-Ffc-2CTfc-2 

E 

\\Pk-i\\k-, 

= E 

\\Pk — 2\ \sk-iFk-id-k-i 


9k-20'k-2 


(57) 


9k-l<Fk-l 


(58) 


E[||PivllL] 


= E 



2 

snFn^n 


9NO-N 


(59) 
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We can see from ([5^ that E 




in term of 


E 


\\Pk- 


2 lIsfc-iFfc-iCTfc-i 


. Now, if we choose the weighting 


vector ak -2 = Sk-iFk-i(Jk-i in we get 


E 


\\Pk-2\\ 


^k—1 P'k — l^k — l 


:E 


\\Pk 2}\ Sk-\Sk-2Fk-2Fk-io-k-i 
F Sk-igk-2Fk-i^k-i (60) 


Replacing ( [60| ) in ( [58] ) yields 


E 


—1 llcTfc-i 


= E 


\\Pk—?>\\sk-iSk-2Fk-2Fk-i<yk-i 
+ Sk-igk-2Fk-l^k-l 
Fgk-i^k-1 (61) 


Iterating in this manner, we can obtain an expression for 


E 


E 


lli^/c —1 llcTfc-l 
\\Pk-l 


as follows 


2 

cfk-i 


= E 


Using 

form 


+ 5fc-Ffc+i • • • F'f^Fi... Fl._-^ak-i 
+ fffc+i-Pfe+g • • • FkF[... Fl_^ak-i 

+ ■ ■ ■ + 5fc-2-F’;fe-iC’'fe-i + flfc-io'fe-i (62) 

and ([49]) we can represent ([62]) in the following 


E 



2 

{I — ^k,l)(Fk-l 


^k^k — 1 • 


(63) 


Finally, we use equation ( [63] ) to derive the required metrics 
at node k. In fact, since we are free to select the weight 
vector cT/c-i, choosing (Jk-i = (/ — n/c,i)“^diag{/} results 
in the expressions for the steady-state MSD as given by 
Likewise, letting (Tk-i = {I — 11/^,!) ^\k results in the 
expressions for the steady-state EMSE as given by (|4|l. 
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